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C<") . Abstract 

In this paper, we establish hardness and approximation results for various L p -ball con- 
strained homogeneous polynomial optimization problems, where p e [2,oo]. Specihcally, we 
prove that for any given d > 3 and p G [2, oo], both the problem of optimizing a degree-d ho- 
mogeneous polynomial over the L p -ball and the problem of optimizing a degree-G? multilinear 
form (regardless of its super-symmetry) over L p -balls are NP-hard. On the other hand, we 
show that these problems can be approximated to within a factor of fi ((log n)( d ~ 2 )/ p /n d / 2 ~ 1 ) 
in deterministic polynomial time, where n is the number of variables. We further show 
that with the help of randomization, the approximation guarantee can be improved to 
n((\ogn/n) d ^ 2 ^ 1 ), which is independent of p and is currently the best for the aforemen- 
■ tioned problems. Our results unify and generalize those in the literature, which focus either 

on the quadratic case or the case where p € {2, oo}. We believe that the wide array of tools 
used in this paper will have further applications in the study of polynomial optimization 

. problems. 
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1 Introduction 



Motivated by its diverse applications and profound connections to various branches of mathemat- 
ics, polynomial optimization has been the focus of much research effort during the past decade or 
so. Prom an algorithmic perspective, polynomial optimization problems are generally intractable. 
Thus, a fundamental research issue is to determine their approximability. One important class 
of problems whose approximability has been extensively investigated in recent years is that of 
homogeneous polynomial optimization with Z/2-norm constraints. The first results in this direc- 
tion were obtained by de Klerk et al. [9] and Barvinok [3], who showed that certain specially 
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structured ^-sphere constrained polynomial optimization problems admit polynomial-time ap- 
proximation schemes (PTASes). These were then followed by the work of Luo and Zhang [20], in 
which an approximation algorithm was developed for homogeneous quartic optimization prob- 
lems with quadratic constraints (which includes the L2~ball as a special case). Around the same 
time, Ling et al. [18] considered the problem of approximately optimizing a biquadratic func- 
tion over the Cartesian product of two L2-spheres; while Zhang et al. [31] studied the hardness 
and approximability of certain L2~sphere constrained homogeneous cubic optimization prob- 
lems. Since then, there have been significant activities in this line of research. For instance, 
in [301 \19\ [29] , various researchers derived approximation results for the problem of optimizing 
a biquadratic function over quadratic constraints, thereby extending the results in [18]. In [11] . 
He et al. improved and substantially extended the results in [20] by providing approximation 
algorithms for optimizing a general homogeneous polynomial over quadratic constraints (see 
also [16] for some latest developments). It is worth noting that most of the aforementioned re- 
sults were obtained using semidefinite relaxation techniques, and that most of the algorithms are 
randomized. Recently, in a marked departure from the semidefinite relaxation paradigm, So [26] 
employed techniques from algorithmic convex geometry to design deterministic approximation 
algorithms for various ^-sphere constrained homogeneous polynomial optimization problems. 
The algorithms in [26] have a worst-case approximation guarantee of f2((log n/n)^ 2-1 ), where n 
is the number of variables and d is the degree of the polynomial. Roughly speaking, this means 
that given any problem instance, the algorithms will produce a feasible solution whose objective 
value is at least f2((logre/re) d / 2-1 ) times the optimum. This improves upon the ^((l/n)^ 2 - 1 ) 
bound established in [I8j dU [31] and is currently the best for general L2~sphere constrained 
homogeneous polynomial and multiquadratic optimization problems. Such development raises a 
natural question: Can the approach in [26j be applied to other classes of polynomial optimization 
problems? 

In this paper, we address the above question by extending the approach in [26] to study the 
Lp-ball constrained homogeneous polynomial optimization problem; i.e., problem of the form 



where p £ [2, oo] and / : M. n — > 1R is a homogeneous polynomial of (fixed) degree d > 3. Our 
motivation for studying Problem ([1]) is twofold. First, it is a natural extension of the matrix norm 
problem in [5j[28] and the L p -Grothendieck problem in [15] — both of which concern quadratic /'s 
with certain structure — as well as the Loo-ball constrained trilinear optimization problem in [13] 
and the L2~ball constrained homogeneous polynomial optimization problem in |20[lll]. However, 
to the best of our knowledge, there is no prior hardness or approximation result for Problem (pQ) 
in its full generality. Secondly, Problem ([1]) lies at the heart of many applications. For instance, 
Baratchart et al. [3] demonstrated that many labeling problems in pattern recognition and image 
processing can be tackled by maximizing a certain polynomial over an L p -ball. In addition, the 
Lp-singular value and singular vector of a tensor, which have been extensively studied in the 
spectral theory of tensors and play an important role in signal processing, automatic control 
and data analysis, can be defined as the optimal value of and optimal solution to an L p -ball 
constrained homogeneous polynomial optimization problem, respectively |17[ 124] . As our main 
contribution, we obtain both hardness and approximation results for Problem ([I]). Specifically, 
on the hardness side, we show that Problem ([1]) is NP-hard for any given d > 3 and p G [2,oo]. 
To the best of our knowledge, this is the first hardness result for Problem ([I]) that holds for 
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any given d > 3 and p G [2, oo]. By contrast, existing hardness results for Problem (pQ), such 
as those in |22[ [T2l [TJ [31], hold only for certain values of d and p. A key tool we used to prove 
the hardness result is a tensor symmetrization procedure introduced by Ragnarsson and Van 
Loan [25] , which allows us to establish the equivalence between multilinear optimization problems 
and certain homogeneous polynomial optimization problems. On the approximation side, we 
show that Problem (pQ) can be approximated to within a factor of $7 ((log np d ~ 2 ^ p /n d ^ 2 ~^) by 
a deterministic polynomial-time algorithm. Furthermore, if one allows randomization, then the 
approximation bound can be improved to fi((log n/n) d / 2-1 ), independent of p. In the process of 
deriving these results, we also establish the hardness of and develop approximation algorithms 
for certain L p -ball constrained multilinear optimization problems, which could be of independent 
interest. We remark that the aforementioned results apply only to the case where p G [2, oo]. The 
case where p G [1,2), which is not covered in this paper, does not seem to be well understood, 
even when / is quadratic. We refer the interested reader to |28[ El |6] for some results in this 
direction. 

Before describing in detail our approximation algorithms for Problem (pQ), let us give an 
overview of our approach and highlight some of the key technical issues. To fix ideas, let us 
first consider the case where d = 3; i.e., f(x) = Ylijk=i a ijk x i x j x k fo r some order-3 tensor 
A = {ciijk) G R nxnxn . Using by-now standard techniques (see, e.g., [HI [26]), one can show that 
the optimal value of Problem (pQ) is within a constant factor of that of its multilinear relaxation, 
which in the case of d = 3 is given by 

f " \ 

max I ^ o-ijkXiVjZk : \\x\\ p < 1, \\y\\ p < 1, ||z|| p < 1 > . (2) 

[i,j,k=l J 

Thus, as far as approximating Problem (pQ) is concerned, it suffices to focus on Problem ([2]). 
Although the latter generally remains NP-hard (see Proposition Q] and Theorem [3]), intuitively 
it should be easier to handle because of the decoupling of variables. Indeed, following the ideas 
in |13[ [26] , one can show that the optimal value of Problem ([2]) is equal to half times the L q - 
diameter of a certain convex body 1C P , where q = p/(p— 1) G [1,2] is the conjugate of p. However, 
the latter quantity is known to be efficiently approximable only when p = 2. To tackle the case 
where p > 2, we do not work on 1C P directly as in [26]. Instead, we construct another convex body 
JC' p whose Lq-diameter is within a constant factor of the optimal value of Problem ([2]) but can 
be approximated efficiently. The validity of our construction is established using Grothendieck's 
inequality — a tool that originates from functional analysis and has since found many applications 
in optimization and theoretical computer science; see, e.g., [27J, [HI [23] . Consequently, we are 
able to approximate Problem ([2]) and hence also Problem ([1]) in polynomial time for the case 
where d = 3. 

To extend the above results to the case where d > 3, a natural idea is to apply recursion. 
We will present two implementations of this idea, which will lead to two algorithms with differ- 
ent characteristics. The first is based on the following crucial observation (see Proposition [8]): 
Suppose that we have a deterministic approximation algorithm g/j for optimizing a degree-d 
multilinear form over L p -balls, where d > 3. Consider a degree-(<i + 1) multilinear form F. For 
any x 1 G R n , let Gd{x v ) be the value returned by si^ when applied to the degree-d multilinear 
optimization problem 

maxte 1 ,! 2 ,...,!^ 1 ) : \\x% < 1 for % = 2, 3, . . . , d + l) . 
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Then, the function Gd essentially defines a norm on R". Such a property, which was first 
established in [26] for the case where p = 2, is extremely useful and can be of independent 
interest. In particular, it allows us to utilize existing polytopal approximations of L p -balls [8] to 
design a deterministic f2 ((logn)( d_2 )/ p /n d / 2_1 )-approximation algorithm for Problem ([1]). 

The second approach to implementing the recursion idea is by randomization. Specifically, 
consider a degree-d multilinear form F, where d > 3. It is known that if x 2 , . . . , x d € W 1 are 
arbitrary and £ E 1™ is a random vector uniformly distributed on the L^-sphere, then 

max F(x, x 2 , . . . , x d ) 

IMIp<i 

holds with a probability that is at least inversely proportional to a polynomial in n; cf. [131 
Lemma 3.3]. Using this result, it is not hard to show that any /3^_i-approximation algorithm 
for optimizing a degree-(d — 1) multilinear form over L p -balls will yield an Q(/3d-i ylogn/n)- 
approximation algorithm for Problem ([I]). To complete the argument, we show by induction 
that fid-i can 

be taken as f3 d -i = fi((log n/n)^" 1 )/ 2 " 1 ). This gives an ^((logn/n)^ 2 - 1 )- 
approximation algorithm for Problem ([T]). It should be noted that unlike the deterministic 
algorithm described above, the algorithm obtained using this approach is randomized and thus 
will only attain the stated approximation ratio with high probability. However, it is much easier 
to implement than its deterministic counterpart. 

The rest of the paper is organized as follows. Section [2] contains the preliminaries. In Sec- 
tion [3l we show that the problem of optimizing a homogeneous polynomial of fixed degree over 
an Lp-ball is NP-hard. Then, in Section [4l we introduce a multilinear relaxation of the L p -ball 
constrained homogeneous polynomial optimization problem and show that it is equivalent to 
the latter from an approximation perspective. We also discuss the hardness of the multilinear 
relaxation. In Section [5l we develop both deterministic and randomized polynomial-time ap- 
proximation algorithms for the problem of optimizing a multilinear form over L p -balls by relating 
it to the problem of determining the diameters of certain convex bodies. Finally, we conclude 
with some closing remarks in Section [6l 
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2 Preliminaries 

We begin with the notation and definitions used in this paper. A tensor is a multidimensional 
array, and the order of a tensor is the number of dimensions. Let A = (cti 1 i 2 — «d) ^ K niX " 2X '" x,li! 
be a tensor of order d. We denote its (ii,i2, ■ ■ ■ ,«d)~th element by either ai x i 2 ...i d or [^l]^^...^. 
We say that A is non-zero if at least one of its elements is non-zero, and is cubical if n\ = ri2 = 
■ ■ ■ = na- A cubical tensor is said to be super-symmetric if every element Oi 1 i 2 ...i d is invariant 
under any permutation of the indices. 

Let K and j± , j% , • • • , 3k be integers such that 1 < K < d and 1 < ji < j% < • ■ ■ < jx < d. 
Furthermore, let x 3k S R nj fe , where k = 1, . . . , K, be given vectors. We use A(x J1 , x n , . . . , x jK ) 
to denote the order-(d — K) tensor obtained by "summing out" the indices ji, j'2, ■ ■ ■ , Jk from 
the order-d tensor A = (di 1 i 2 ...i d ) G fl£ n i xn 2x---xn d ugni g x h^ x h^ _ _ _ For instance, if K = 2, 

ji = 2 and ji = 4, then 

n 2 n 4 
i 2 = l 14 = 1 
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Given an order-d tensor A = (a^jj...^) G g«ix«2x-xn^ we can assoc i a t e with it a multilinear 
form F A : W L1 x W a2 x • • • x M n <* ->• R via 



m n d 



Fa( x > x i ■ ■ ■ ,x ) — 'y * ■ ■ ■ y * at 1 i 2 ...i d x il 

il=l i d =l 



. . . 

x i 2 x i d - 



If .A is super-symmetric with ri\ = n% = ■ ■ ■ = nd = n, then we can further associate with it a 
homogeneous degree-d polynomial f A : M. n — > M via 



Ia( x ) — Fa( x > x i • • • > x ) — a hi2—id x h x 



i 2 ^i d - 

l<ii,...,i d <n 

In general, even if A is not super-symmetric or even cubical, it is still possible to relate the 
multilinear form F A to a certain homogeneous degree-<i polynomial via symmetrization |25| . To 
introduce this procedure, we need some preliminary definitions. Let it = , %i , . . . , ira) be a 
permutation of the set {1,2, . . . ,d}. The ir-transpose of A = (ai 1 i 2 ---i d ) G K niXn2X "' xn 'i is the 
order-<i tensor A 77 = (ai 7Tl i 7T2 -i 7Id ) ^ ]R n ' r i xn ' r 2 x '" xn ' r [ i whose elements are given by 

a iir 1 »7r 2 ,,, ^>r (i = a iii'2---id f° r = ^' • • • ' n j'i 3 = 1) • • • ) 

Let N = ni + Ti2 + ■ ■ ■ + nd and partition the index set { 1 , . . . , N} into sets of consecutive integers 
as follows: 

{l,...,N} = (jBj, where Bj = <^ n 4 + 1, . . . , ]T n 4 L (3) 

j=l li=l i=l ) 

Given an arbitrary cubical order-d tensor B G and Xi G {1> ■ ■ ■ > d} f° r * = 1, • • • , d, the 
(Xis • • • ) Xd)~th block of £> is defined as the sub-tensor 



n v . xn M x-xn 



^XlX2-Xd - (Ki2-i d )ij£B Xi ;j=l,...,d G ™*2 



Armed with these definitions, we define the symmetrization of .4 = {ai 1 i 2 .„i d 
the order-d cubical tensor sym(„4.) G R^ d whose blocks are given by 



[sym(^)] XiX2 ... Xd 



A x if x = (xi,X2, ■ ■ ■ , Xd) is a permutation of {1,2,..., d}, 
otherwise. 



For instance, when d = 2, A is an n\ x n2 matrix, and its symmetrization is given by the 
well-known construction 

t AS \ A 

sym(^4) = 4 rp 
K ' [ A T 

More generally, it is known that the tensor sym(„4) enjoys the following properties |25j : 

1. sym(^4) is super-symmetric. In particular, it can be associated with a homogeneous degree- 
d polynomial / sym (^). 



2. For every x = [ (x x ) T (x 2 ) T ■ ■ ■ (x d ) T ] G M N , where x l G R ni and i = 1, . . . , d, we have 

fsym(A) 



f sym (A)( x )=dl-F A {x 1 ,x 2 ,...,x d ). (4) 
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Now, let d > 3 and p G [2,oo] be given. Let A = («iii 2 -id) e ^ n< * ^ e an arbitrary non-zero 
super-symmetric tensor of order d, and let : R n — >• R be the corresponding homogeneous 
polynomial. Our main objective in this paper is to study the algorithmic aspects of the following 
Lp-ball constrained homogeneous polynomial optimization problem: 

v = maximize f A (x) = ^ a il i 2 ...i d x il Xi 2 ■ ■ ■ x id 

(HP) l<h,...,i d <n 

subject to < 1, x G R n . 

3 Hardness of L p — Ball Constrained Homogeneous Polynomial 
Optimization 

We begin with the following result, which concerns the complexity of Problem (HP): 

Theorem 1 Problem (HP) is NP-hard for any given d > 3 and p G [2, oo]. 

The proof of Theorem Q] consists of two steps. First, we show that the problem of maximizing a 
degree-d multilinear form over L p -balls is NP-hard for any given d > 3 and p G [2,oo]. Then, 
we give a polynomial-time reduction of this problem to Problem (HP) using the symmetrization 
procedure introduced in Section [21 thereby proving the NP-hardness of the latter. 
To begin, let us formally define the problem used in the first step. 



Let A = {o.i 1 i 2 ---i d ) G ]j n i xn 2x---xn d k e an arbitrary non-zero order-d tensor, and 
let F4 : M ni x W 12 x • • • x M nd — > R be the corresponding multilinear form. Solve 

VM\_{A,d) = maximize F^x 1 , x 2 , . . . , x d ) 

subject to < 1, x l G R n * for % = 1, . . . , d. 



We then have the following result: 

Proposition 1 Problem (ML) is NP-hard for any given d > 3 and p G [2, oo]. 

Proof Let d > 3 and p G [2, oo] be fixed. Consider first the case where p G (2, oo]. Our plan is 
to reduce the following problem — which is known to be NP-hard |28] — to Problem (ML): 



Let B G R mxn and p G (2, oo] be given. Let q = p/(p — 1) be the 
(NORM) conjugate of p. Compute the p — )■ q norm of B, where 
\\B\\ p ^ q = m?Qt{\\By\\ q : \\y\\ p < 1}. 



Towards that end, suppose that we are given an instance of Problem (NORM). By Holder's 
inequality, we have 



max ||.By|L = max x By 
IMIi><i IMIp<i,IMIp<i 



max 

IMIp<i. IMIp< 

l z ll.--->l z d-2l< 



1 (jl x T By 



max Fa {zi,z 2 , . . . , Zd-2, x, y) , 
Inl.-.kd-al^ 1 
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where A = (ai G K lx --- Xlxmx?1 i s the order-d tensor with 01 iy = b{j for i = 1, ... , m 

and j = 1, . . . , n; F4 : R x • • • x R x R m x R n — >■ R is the multilinear form associated with A. 
This establishes the NP-hardness of Problem (ML) when d > 3 and p G (2, 00]. 

Next, consider the case where p = 2. It has been shown in Proposition 2] that Problem 
(ML) is NP-hard when d = 3 and p = 2. Now, let B = (b ijk ) G R"ixn 2 xn 3 ^ e an arbitrary 
non-zero order-3 tensor, and let Fq : R ni x R n2 x R™ 3 — > R be the corresponding multilinear 
form. Using similar argument as above, for any given d > 4, we have 

/tt \ 

max F B (w,x,y) = max TT ) i*jg(i£>, sc, y) 

1Mb, Iklh, IImIIi<i \ x a / 



[|w||2 9 |[*||2, ||3/||2<1 



l.-.l^d-sl^ 1 Vi=1 



IMIa> \m\2< llflh^ 1 

where A = (ai,...,!,^*) G jgix---xixnixn 2 xn3 j g orc jer-(i tensor with ai,...,!^* = i>yfc for 
i = 1, . . . , rai, j = 1, ■ ■ ■ ,n 2 and k = 1, . . . , rt 3 ; F A : R x • • • x R x R m x R 712 x R na -)• R is the 
multilinear form associated with .4.. Thus, we conclude that when p = 2, Problem (ML) remains 
NP-hard for each fixed d > 3. □ 

Next, we have the following proposition, which links the optimization of the multilinear form 
associated with a tensor A to that of the homogeneous polynomial associated with sym(„4). 

Proposition 2 Let d > 2 and p G [2, 00] be given, and let A G f"i xn 2 x - x "d fr e an arbitrary 
non-zero order-d tensor. Set N = m + n2 + ■ ■ ■ + rid- Consider the optimization problems 

subject to \\x' l \\p < 1, x l G R™ 1 /or i = 1, . . . , d 

and 

maximize f sym {A)( z ) 

(6) 

subject to \\z\\ p < d 1 ^, z G R^, 

where -F4 is the multilinear form associated with A and f S ym(A) * s ^ e homogeneous polynomial 
associated with the symmetrization of A (see Section^. Let {x l ,x 2 , . . . ,x d ) G R ni x R n2 x • • • x 
R nd and z = [ (>2 1 ) T (z 2 ) T ■ ■ ■ (z d ) T ] , where z % G R ni for i = 1, . . . , d, be optimal solutions to 
problems (0) and (0|) ; respectively. Then, the following hold: 

(a) || 2* [|p = 1 for i = 1, d. 

(b) (z\z 2 ,...,z d ) G R"iX"2X-xn d and x= [(x 1 )? (x 2 ) T ■■■ (x d ) T ] T eR N are optimal solu- 
tions to problems (0) and respectively. 

Proof Let us first consider the case where p = 00. By Problem ([6]) is equivalent to 

maximize d\ ■ F^z 1 , z 2 , . . . , z d ) 

subject to H^Hoo < 1, z l G R ni for i = 1, . . . , d, 

which has exactly the same form as Problem ([5]). Thus, the desired results follow immediately. 
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Now, consider the case where p G [2, oo). To prove (a), we again appeal to which implies 
the equivalence of Problem (|6|) and the following problem: 



maximize dl ■ F^z 1 , z 2 , . . . , z d ) 



subject to 



d 

E 

i=l 

z i G 



A\ P P <d, 



Since A is non-zero, we must have 
that \\z ] \\p = 6 7^ 1 for some j G {1, 



' for i = 1, . . . , d. 

d and ||f l || p > for i = 1, . . . , d. Now, suppose 



, d}. Then, we have Yltyj 1 1 •'- 



»IIP 



d— > 0. Upon setting 



d 



8 1 ' p z-' otherwise, 



we obtain 



and 



y3\\P 



Ei 

i=l 



d-0 



-Ei 



+ z- 



F A (z\z 2 , . . . , z d ) = (d - 1)^ • ((d - fl)*" 1 *) VP • ^(z 1 , z 2 , . . . , A 



(7) 



In particular, we see that z = [ (z 1 ) T ( 



1\T / S 2\T 



(z d ) T ] G R is feasible for ([6]). It is easy to verify 



that the function t i— >■ ((d — t) d ~ l t))~ l l p is strictly convex on (0,d) and is minimized at t = 1. 
Since 7^ 1 and *A is non-zero, it follows from ([7]) that F^ii 1 , z 2 , . . . , z rf ) > F^z 1 , z 2 , . . . , 
which contradicts the optimality of z. Thus, we have \\z l \\p = 1 for i = 1, . . . , d, as desired. 



To prove (b), we first observe that since x = [ (; 



(x d ) T ] 6 R^ is feasi- 



ble for Problem 



and / s 



sym(.4) \ x ) 



d! • F A (x 1 ,x 2 ,...,x d ) by (@D, we have f sym r A )(z) > 



d! • ^(x 1 , x 2 , . . . , x d ). Now, the result in (a) implies that (z 1 , z 2 , . . . , z d ) G 



pni xrt2 X ■■■xn t j 



,(*) = d\-F A (z\z 2 ,...,z d ) 



feasible for Problem (0), and hence using (HJ) we obtain / aym (^)( 
dl • , x 2 , . . . , This completes the proof. 

We are now ready to complete the proof of Theorem [TJ 

Proof of Theorem [TJ Proposition [2] implies that Problem (ML) is equivalent to 

maximize f sym (A)(. z ) 



is 

< 

□ 



subject to 



< 1, z G 



where N = n\ + ri2 + • • • + n^. The latter is clearly an instance of Problem (HP). Moreover, 
when d > 3 is fixed, the size of sym(„4) is polynomial in n\, 112, ■ ■ ■ , n^. Thus, for any given d > 3 
and p G [2, 00], we can reduce Problem (ML) to Problem (HP) in polynomial time, which implies 
that the latter is NP-hard, as desired. □ 
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4 L p — Ball Constrained Homogeneous Polynomial Optimization 
and Its Multilinear Relaxation 

In view of Theorem [TJ we now turn our attention to the task of designing polynomial-time ap- 
proximation algorithms for Problem (HP) with provable guarantees. Towards that end, consider 
the following multilinear relaxation of Problem (HP): 

v* = maximize F^x 1 ,x 2 , . . . ,x d ) = a i\i"i---%d x \\ x \' ' ' x t A 

(MR) l<ii,...,i d <n 

subject to \\x l \\ p < 1, x l G M. ni for i = 1, . . . , d. 

Since /a{ x ) = Fa{ x i x, . . . ,x) for all x G M n and x = is feasible for Problem (HP), we clearly 
have v* > v > 0. Our motivation for studying Problem (MR) comes from the following result, 
which essentially states that v* and v are within a constant factor of each other when d > 3 is 
fixed. 

Theorem 2 Let d > 3 and p G [2, oo] be given. Suppose there is a polynomial-time algorithm 
£^mr that, given any instance of Problem (MR), returns a feasible solution whose objective value 
is at least av* for some a G (0,1]. Then, there is a polynomial-time algorithm s^wp that, given 
any instance of Problem (HP), returns a solution x G W 1 with \\x\\ p < 1 and 

f A {x) > a-d\-d~ d -v* 

> a-d\-d~ d -v for odd d > 3, 

fA(x) -v > 2a-d\-d~ d -v* 

> a ■ d\ ■ d~~ d ■ (v — v) for even d > 4, 

where v = mirLii^if <i In other words, the algorithm £/^p has an approximation guarantee 

(resp. relative approximation guarantee,) of a ■ d\ ■ d~ d when d is odd (resp. even). 

For a proof of Theorem [2j see Appendix [Aj We remark that for the case where p = 2, an 
analogous result has been established in [IT]; cf. [26, Theorem 1]. 

Theorem [2] shows that any algorithm for solving Problem (MR) will translate into an al- 
gorithm for approximating Problem (HP). Although it seems intuitive that Problem (MR) is 
NP-hard as well, such a result does not follow directly from Proposition [lj as the tensor associ- 
ated with the objective function in Problem (ML) is not required to be super-symmetric or even 
cubical. The following theorem fills this gap: 

Theorem 3 Problem (MR) is NP-hard for any given d>3 and p G [2, oo]. 

The proof of Theorem [3] is quite involved and can be found in Appendix [Bj We remark that 
Theorem[3]is, to the best of our knowledge, the first hardness result for the problem of optimizing 
a super-symmetric multilinear form that holds for any given d > 3 and p G [2,oo]; cf. [12] . 
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5 L p — Ball Constrained Multilinear Optimization and Diameters 
of Convex Bodies 

Given that both Problem (MR) and Problem (ML) are NP-hard, we shall study the slightly 
more general Problem (ML), where the focus will be on developing approximation algorithms 
with provable guarantees. Since the case where p = 2 has already been investigated in |26j . we 
shall assume that p £ (2, oo] in the sequel. 

5.1 Base Case: Approximating L p -Ball Constrained Trilinear Maximization 

Let us begin by considering the case where d = 3. Specifically, let A = (ajjfc) S W llXn2Xn:i be an 
arbitrary non-zero order-3 tensor. Without loss of generality, we assume that 1 < n\ < ni < n^. 
Then, Problem (ML) becomes 

n\ "2 "3 

vwu_{A, 3) = maximize aij\~x\x 2 jx\ 

i=i j=i k=i (8) 

subject to \\x% < 1, x i € M™ 1 for i = 1, 2, 3. 
Using the definition of A(x 1 ) and Holder's inequality, we can express vml(A, 3) as 
Vm\(A,3) = max max (x 2 ) T A(x l )x 3 

||xl|| p <l||x2|| p <l,||x3|| p <l V 



max max ^(x 1 )^ 31 



C 1 L<1 l|a: 3 ||p<l 



= max WAix 1 )^, (9) 

If IIp<! 

where q = p/(p— 1) is the conjugate of p and ||^4(aJ )[|p^. g is the p — >■ g norm of the n2 x 713 
matrix ^(x 1 ). From the above derivation, we see that Problem ([8]) encapsulates two difficult 
computational tasks: (i) the computation of ^(x 1 )^-^ for any given x 1 G M ni , and (ii) the 
maximization of a convex function x 1 h-> ||^4(x over a convex set -B^ 1 ={i£ M ni : ||x|| p < 

1}. To tackle these difficulties, we proceed in two steps. First, we show that H^x 1 )!^-^ can be 
approximated by another efficiently computable norm. Then, we show that the maximization 
of this latter norm over B™ 1 is equivalent to determining the Lg-diameter of a certain convex 
body, a problem for which approximation algorithms are available. This would in turn yield 
approximation algorithms for Problem ([8]). 

Step 1: Approximating when p G (2, 00]. The task of computing for any 

given m x n matrix B and p £ (2, 00] is an instance of the matrix norm problem, which has 
been extensively studied in the literature. In particular, Nesterov [21] showed that H-BHp-^ can 
be approximated to within a factor of — | > 0.435 via a certain convex relaxation. Later, 
Ben-Tal and Nemirovski [3] and Steinberg [2S] established the NP-hardness of the problem and 
gave a more refined analysis of Nesterov's relaxation scheme. However, the approximation bound 
they obtained is better than Nesterov's only when the parameters m,n,p belong to a certain 
regime. As it turns out, by considering a different convex relaxation, it is possible to obtain an 
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approximation bound that uniformly improves upon that of Nesterov. To demonstrate this, we 
first observe that 



\B\ 



1 





B ' 




y 


maximize — 


B T 





• 


2 




z 



[y 



T T 

Z 



(10) 



subject to 1 1 2/ II jo < 1; 



\ z \\p ^ !> 



where P»Q = tv(P T Q) denotes the Probenius inner product of the matrices P and Q. Hence, by 
introducing the (m + n) x (m + n) positive semidefinite (psd) matrix X to replace the rank-one 
psd matrix (y, z)(y, z) T and denoting 



B 



we obtain the following relaxation of ||i?| 



1 

" 2 



vec p (B) 



5 
5 T 



m+n 



max <j £ • X : ^ |^|^/ 2 < 1, ^ |-X#| p/2 <l,IhO 

i=l jr'=m+l 



max < _B • X : max < 1, max l^ji'l < 1, X >z 



for p G (2, oo), 
for p = oo. 



(11) 

Note that for p > 2, Problem (|lip is a convex program that can be solved to arbitrary 
accuracy in polynomial time using, e.g., the ellipsoid method [10] (cf. |15j). Moreover, the 
following simple observation of Khot and Naor |14| shows that the ratio between vec p (B) and 
\\B 

than ^htwt) < L783 ra- 

Proposition 3 The following inequalities hold: 



p^ q is bounded above by the Grothendieck constant Kq, which is known to be strictly less 



\B\ 



p->q 



< vec p (B) < K G ■ \\B\\ p ^ q . 



For completeness, we include the proof of Proposition [3] here. 

Proof The first inequality follows readily from the fact that Problem (|lip is a relaxation of 
Problem ()10p . To prove the second inequality, consider an optimal solution X* to Problem (jlip 
with rank(X*) = r > 1. Let X* = V T V, where V G W x ( m+n \ be the Cholesky factorization of 
X* . Furthermore, let U{ G W (where i = 1, . . . , m) and Vj G M r (where j = 1, . . . , n) be the z-th 
column and (m + j)— th column of V, respectively. Then, by the optimality of X* , we have 



vec p (B) = B»X* 



EE* 

i=i j=i 



Moreover, since diag(-B) = 0, we may assume that 

\\ Ui \\ 2 = IX*^ 2 = 1 for 1 < i < m, 

\\vj\\2 = iXjjl 1 / 2 = 1 for m + 1 < j < m + n 
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in the case where p = oo, or 

mm n rn+n 



EiNi2 = £ra p/2 = i, £imis= E 



|P/2 

i=l i=l j'=l j=m+l 



in the case where p E (2,oo). Now, define an m x n matrix Q by Qij = -B^- • ||tti||2 • ll^jlbi where 
i = l,...,m and j = 1, . . . , n. By the Grothendieck inequality (see, e.g., [21 Q3]), there exist 
vectors rj £ {— 1, l} m , 7 G {—1, l} n such that 

m n m n j> m n 

vec p (B) = J2E B « u T v i = E E <fo ii 7/ Z II -^ G EE QijVUj- (12) 

1 = 1 J = l 1 = 1 .7 = 1 J 4=1 J = l 

Upon letting yi = r\%- \ui\i for i = 1, . . . , m and Zj = 7j • ||«j||2 for j = 1, . . . ,n, we see that 
llyllp = ll^llp = 1 f° r jP ^ (2,oo]; i.e., (£/, z) G M m x lR n is feasible for Problem (jlOp . Moreover, we 
obtain from (|12j) that 

m n 

vec p (B) < K G ■ EE" 8 ^^' < Kq ■ \\B\\ p ^ q . 
i=l i=i 

This completes the proof. □ 

The proof of Proposition [3] reveals that known algorithmic implementations of the Grothendieck 
inequality (see, e.g., [21 [7J) can be used to deliver vectors y £ W 11 and z £ that are feasible 
for Problem (|10p and whose associated objective value y T Bz is within a constant factor of 
||S[L_j.q. It should be noted, however, that the precise constant will depend on the particular 
implementation used. For our purposes, we shall consider two different implementations of 
the Grothendieck inequality. The first is a deterministic procedure introduced in [2j, which 
is based on the construction of small sample spaces with many four-wise independent random 
variables. It guarantees that Kq < 27, and hence by Proposition[3]there is a deterministic (1/27)- 
approximation algorithm for computing Although the above procedure does not yield 

the best approximation bound for (in fact, it is even worse than Nesterov's bound), it will 

allow us to design a deterministic approximation algorithm for Problem (ML). The second one 
is based on the so-called Krivine rounding scheme in [7J . The resulting procedure is randomized 
and guarantees that Kq < 2 \ n (i+^2) ; which is currently the best bound on Kq. Consequently, 

we can approximate ||-B|| P ^ to within a factor that is strictly larger than 21n (i+v / 2) -> 0.561, 
which is better than Nesterov's bound of 0.435. 

Based on the above discussion, we summarize our procedure for approximating ||S|| P ^ 9 in 
Algorithm [TJ 

Step 2: Norm Maximization and Diameters of Convex Bodies. In view of ([9]) and 
Proposition [3l we see that any a-approximation to 

max veCp (^.(x 1 )) (13) 

ll 2 -' 1 llp^i 



will yield an (a/i^c)-approximation to vml(A,3). Hence, it suffices to focus on Problem (jT3j) . 
The following result shows that Problem (|13p is in fact equivalent to maximizing a certain norm 



over the L p -ball. 
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Algorithm 1 Procedure for Approximating ||2?|| p _> 9 when p G (2, oo] and q = p/(p— 1) 
Input: An m x n matrix B, a rational number p G (2, oo]. 
Output: A feasible solution (y,z) G M m x E n to Problem (fT0j) . 
1: Solve the convex relaxation fllip and let A* — be an optimal solution. Let wi, . . . , u m 

and vi, . . . , v n be the first m and last n columns of V, respectively. 
2: Apply either the deterministic rounding procedure in [2] or the randomized rounding pro- 
cedure in [7] to the vectors {^i/lluilbl^Li and j ||2}j=i to obtain vectors rj G {—1, l} m 
and 7 G {—1, l} n that satisfy (|12p . where Kq < 27 if the deterministic procedure in [2] is 
used and Kq < 2 \ n (i +% /2) ^ the randomized procedure in [7] is used. 
3: Set yi = rji-\\u\\2 for i = 1, . . . ,m and Zj = Tj-ll^jlb for j = 1, . . . ,n. Return (y,z) G l m xM". 



Proposition 4 Let A = G R niXn2Xn 3 fr e an arbitrary non-zero order-3 tensor. Consider 

the (re 2 x n%) x rai matrix A given by 

A (j,k),i = a-ijk for i = 1, . . . ,m; j = 1, . . . ,n 2 ; = 1, . . . ,n 3 . (14) 

Suppose that A has full column rank. Then, the function x 1 t-t vec p (^.(x 1 )) defines a norm on 
R ni . 

Proof Using the definition of A(x 1 ) and the derivation in the proof of Proposition El we have 

ni / n 2 n 3 \ 

veCp (^(x 1 )) = maximize aijkujv k I x* 

i=i \i=ifc=i / 

subject to ||u|| p < 1, ||v|| p < 1, 

(15) 

u= (||ui|| 2 ,...,||u Ba || 2 ) G K™ 2 , 
v = {\\v x || 2 ,..., ||^3 1| 2 ) 

for any p G (2, oo]. In particular, vec p (^4(-)) is the pointwise supremum of a collection of linear 
functions, which implies that vec p (*4(-)) is convex. Moreover, it is clear that vec p (A(kx 1 )} = 
\k\ ■ veCp (^(x 1 )) for any k G R and x 1 G M ni , which together with the convexity of vec p (*A(-)) 
implies that vec p (*4(-)) satisfies the triangle inequality. Finally, let x 1 G M rai \{0} be arbitrary. 
Note that A has full column rank if and only if ^27=i a ijk x i 7^ for some j = 1, . . . , n 2 and 
k = 1, . . . , ra3 if and only if 



vec„ (Aix 1 )) > max 

v ' l<j<n 2 ,l<k<n 3 



1=1 



> 0. 



This shows that x 1 = whenever vec p (^(x 1 )) = 0, and the proof is completed. □ 

Using the argument in [26\ Section 3.1], we may assume without loss that A has full column 
rank; i.e., vec p (*4(-)) defines a norm on M. ni . We shall denote this norm by || • ||^4 in the sequel. 
To proceed, consider the unit ball of the norm || • \\ A and its polar, which are given by 

B A = {x G R ni : \\x\\ A < 1} 
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and 

B° A = {y G R ni :x T y<l for all x G B A ) , 

respectively. Note that both Bj± and are centrally symmetric and convex. Now, using the 
dual characterization of norms and Holder's inequality, we can write Problem f)13|) as 

rp 1 

max \\x \\a = max max x y = max \\y L = -di&m a (B A ), (16) 

where q = p/(p—l) is the conjugate of p and diam^i?^) is the L g -diameter of B^. In particular, 
our original problem of approximating vmi_(A, 3) (see ([8])) is reduced to that of approximating 
diam g (i?^), which is well studied in the literature. In the following, we shall present two al- 
gorithms for approximating di&m q (B^). The first is deterministic and implements an idea of 
Brieden et al. [8]. The second is based on a probabilistic argument of Khot and Naor |13| . 
Although the latter is randomized, it is much simpler to implement and achieves a better ap- 
proximation ratio than the former. 



5.1.1 Approximating the L q Diameter of B^ when q G [1,2) 

Deterministic Approximation of diam^i^). The key observation underlying the determin- 
istic approximation algorithm is that the diameter of a convex body with respect to a polytopal 
norm can be computed to arbitrary accuracy in deterministic polynomial time under certain 
conditions [8|. Thus, in order to approximate the L ? -diameter of B^, it suffices to first con- 
struct a centrally symmetric polytope P that approximates the unit Lq-ball, and then compute 
the diameter of B°^ with respect to the polytopal norm induced by P. Before we describe the 
algorithm in more detail, let us recall some definitions from the algorithmic theory of convex 
bodies (see [10] for further details). For p > 2, let B™(r) = {x G W 1 : \\x\\ p < r} denote the 
n-dimensional L p -ball centered at the origin with radius r > 0. Let K be a centrally symmetric 
convex body in W 1 . For any e > 0, the outer parallel body and inner parallel body of K are given 
by 

K{e) = K + B%{e) and K{-e) = {x G R n : x + B%{e) C K}, 

respectively. We say that K is well-bounded if there exist rational numbers < r < R < oo 
such that -B^r) C K C B'^iR)- The weak membership problem associated with K is defined as 
follows: 

Weak Membership Problem. Given a vector y G Q n and a rational number e > 0, either (i) 
assert that y G K(e), or (ii) assert that y K(—e). 

A weak membership oracle for K is a black box that solves the weak membership problem 
associated with K. 

The starting point of our algorithm for approximating diam,j(i^) is the following result of 
Brieden et al. [8]: 

Theorem 4 Given an integer n > 1 and a rational number q G (1,2], one can construct in 
deterministic polynomial time a centrally symmetric polytope P in M. n such that (i) B^(l) C 
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P C B™ (O (n 1 / 2 /(log n) 1 ^)) , where p = q/(q — 1) is £/te conjugate of q, and (ii) for any well 
bounded centrally symmetric convex body K in W 1 , one has 

( (logn) 1/p \ 

$7 I — I ' diam q (K) < diamp(K) < diam q (K), 




where diamp(K) is the diameter of K with respect to the polytopal norm \\ ■ \\p induced by P 
(i.e., for any x G W 1 , one has \\x\\p = min{A > : x G XP}, and P is the unit ball of the induced 
norm). Moreover, if K is equipped with a weak membership oracle, then for any given rational 
number e > 0, the quantity diamp(K) can be computed to an accuracy of e in deterministic 
oracle-polynomial tim$\, and a vector x £ K (e) is delivered with \\x\\p > (1/2) • diamp(K) — e. 

Armed with Theorem^ we see that in order to design a deterministic polynomial-time algorithm 
for approximating di&m q (B°^), it remains to show that B°^ is well-bounded, and that there is a 
deterministic polynomial-time algorithm for solving the weak membership problem associated 
with B°j^. This is done in the following proposition: 

Proposition 5 Let A = {aijk) £ Q™i x ™2xn. 3 ^ g an ar bitrary non-zero order-3 tensor, and let 
A be the (ri2 x nA x m matrix given by (7^). Suppose that A has full column rank. Then, the 
following hold for the centrally symmetric convex body B^ : 

(a) B°^ is well-bounded. Specifically, there exist rational numbers < r < R < oo, whose 
encoding lengths are polynomially bounded by the input size of Problem (Ej), such that 



(a) By polarity, we have B^(r) C B° A C B^(R) if and only if B^A/R) C B A C B^(l/r). 
Thus, it suffices to show that Bj± is well-bounded. Now, using the argument in 
Proposition 2] and the assumption that A has full column rank, one can show that B^ 1 (r ; ) C 
B A C B^(R'), where 



are rational numbers and satisfy < r' < R' < oo. Moreover, the encoding lengths of 
r' and R' can be polynomially bounded by the input size of Problem ([8]); see |10j . This 
establishes (a). 

An algorithm has oracle-polynomial time complexity if its runtime is polynomial in both the input size and 
the number of calls to the oracle [10] , 




Proof 




and 
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(b) By the well-boundedness of B A and the results in [TUl Chapter 4], it suffices to show 
that the weak membership problem associated with Bj± can be solved in deterministic 
polynomial time. However, this follows directly from the argument in [261 Proposition 3] 
and the observation that [|ar||,4 can be computed to arbitrary accuracy in deterministic 
polynomial time (see (llip and the remarks following it). 

Using ()16p . Proposition [5] and Theorem [J we conclude that the optimal value of Problem 
(|13p can be approximated to within a factor of Mlogm) 1 / p /n]^ 2 J in deterministic polynomial 
time. Thus, by ([9]) and Proposition [3l the optimal value of Problem ([8]) can also be approximated 
to within a factor of 0, ^(log n±) 1 / p /n^j in deterministic polynomial time. To extract a feasible 

solution to Problem (|8|) with the stated approximation guarantee, we just need to unwind our 
sequence of reductions. For simplicity, let us assume that all computations can be done exactly. 
Then, by Proposition [5] and Theorem [U we can find a centrally symmetric polytope P and a 
vector y 6 B°^ such that 

\\y\\ q > \\y\\p = ^diamp(^) > n ^ (1 ° g J / 1 2 )1/ ^ • diam q (B° A ). (17) 

Now, define the vector x 1 G W 11 by 

-i sgn(yj) • \yi\ q ~ l . 

x i= „_„ q -i for z = 1,. . . ,ni. 

\\VM 

It is easy to verify that \\x \\ p = 1 and 

vec p (Aix 1 )) = \\x l \\ A = (x l ) T y = \\y\\ q . (18) 

In particular, by applying the deterministic version of Algorithm [1] to the ri2 X matrix ^(x 1 ), 
we can extract two vectors x 2 £ W 12 and x 3 G M n3 such that ||x 2 |L = ||x 3 |L = 1 and 



"•1 •"A '"O ^ 

a iikxlx 2 j4 > ^vec p {Aix 1 )) . (19) 

i=i j=i k=i 

Finally, since ©, (fl~6|) and Proposition [3] together imply 

^diamg(B^) = max \\x\\ A > max \\A(x 1 )\\ p ^ q = vml(A,3), 

2 IMIp^ 1 II a^ 1 II i= < 1 

we conclude from (fT7D-(fl~9l) that (x 1 ,^ 2 ,^ 3 ) E W 11 x R n2 x W 13 is an Q ((logni) 1 ^/^ 2 )- 
approximate solution to Problem ([8]). 

Recall that the above conclusion is obtained under the assumption that all computations 
are exact. However, it can be shown via a similar but more tedious calculation that the same 
conclusion holds when the computations are inexact; cf. [26] . Thus, we have proven the following 
theorem: 
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Theorem 5 For any given p G (2, oo], there is a deterministic polynomial-time approximation 
algorithm for Problem with approximation ratio Q ( (logm) l / p /n\ 



The following corollary is a direct consequence of Theorems [2] and [5j 

Corollary 1 For d = 3 and any given p G (2,oo], there is a deterministic polynomial-time 
approximation algorithm for Problem (HP) with approximation ratio $7 ((log n) 1 l p jn 1 ! 2 ^ . 

Randomized Approximation of diam q (B^). In this section, we consider an alternative ap- 
proach to approximating diam g (i?^), namely, via randomization. The theoretical underpinning 
of this approach is the following probabilistic results due to Khot and Naor [13J: 

Proposition 6 The following hold: 

(a) Let £i,...,£ n be i.i.d. Bernoulli random variables and set ( = (£i,---,Cn) G K n . Then, 
there exist universal constants 5q, cq > such that for every w G W 1 , 



D / T/v Mo logra |, \ c 

Pr \ w C > \ • \\w i > 

I V n J ~ n 5 ° 

(b) Suppose that q G (1,2), and let p = q/(q — 1). £e£ £i, . . . , £ n be i.i.d. random variables with 
density p ■ exp(— \t\ p )/(2T(l/p)) and set £ = (£i, • • • , £n) G Then, there exist universal 
constants 5\,ci,C2,n > such that for all n > n, we have 



\u\\p - V n 11 lk y - n c * 

/or every w G M n . 

Remark. An inspection of the proofs in [13] reveals that one can take 



*=i' co= 4 (20) 

E fcil 3 11 

>777w c l = 777> C 2 = 77T> " = 41 - ( 21 ) 



160 x 2 2 /<? 6400' 144' 40 

Using Proposition El we can prove the following result: 

Proposition 7 For any given q G [1,2), there is a randomized polynomial-time algorithm that 
returns a vector v G M. U1 with the following property: 



Pr 



£7 ( \ j — - — - ] • diam q (B^) < 2||i;||_4 < diam q {B°^) 



l 

> -. 

~ 2 



Proof Since B^ is compact and x i— > \\x\\ q is continuous, there exists a y G -B^ such that 
||y|| g = diam g (i?^)/2. We consider two cases: 
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Case 1: q = 1. Let 5o,cq be as in (|20p and set M = (ln2)n*°/co. Consider a collection 
{£j : i = 1, . . . , M; j = 1, . . . , ni} of i.i.d. Bernoulli random variables. Define 

C = (Ci,-.., CJelT 1 for* = l,...,M, 

i* = arg max HOIU, « = t = 2||v |U. 

1<»<M 

We claim that v has the desired property. Indeed, it is clear from (|16p that r < diami(i?^). 
Moreover, upon recalling that || 011.4 = max ye 5° y T C an d using Proposition E( a), we have 



<5 logni j: /nD1 | ^ 1 „_ / ^ J _ T i _ /5 logni 



Pr(r> A /^i. diami (^)j > i_ Pr ^n|^<y-^i.|| 9 || 1 



\ M 



2 '"l 

1 

£ r 

which establishes the claim. 

Case 2: q £ (1,2). Let 5\,c\,C2 be as in ([2T]) and set M = (In 2)n'[ 2 / c i- Consider a collection 
: i = 1, . . . , M; j = 1, . . . , n{\ of i.i.d. random variables with density p ■ exp(— \t\ p ) / (2T (1 / p)) , 
where p = q/(q — 1). Define 

f = (d,---,4)eR ri1 , f = X" for i = l,...,M, 

II? Hp 

= arg max ||^*|U, v = , r = 2|b IU. 

l<j<A/ 

Using Proposition [6{b) and our previous argument, we have r < diam g (i?^) and 

1 

> -. 

- 2 

This completes the proof of Proposition [7J □ 

By combining Proposition [7J with the procedure outlined in the paragraph above Theorem [5j we 
can extract an Q ( i/log ni jn\ )-approximate solution to Problem ([8]). Thus, we have proven the 
following theorem: 

Theorem 6 For any given p £ (2,oo] ; there is a randomized polynomial-time approximation 
algorithm for Problem (0j with approximation ratio ^(ydog n\/ni). In particular, for d = 3 
and any given p 6 (2,oo] ; there is a randomized polynomial-time approximation algorithm for 
Problem (HP) with approximation ratio Q>(\f\ogn/n). 
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5.2 General Case: Approximating L p — Ball Constrained Multilinear Maxi- 
mization via Recursion 

Now, let us consider the problem of maximizing a degree-d multilinear form over L p -balls, where 
d > 4 and p G (2, oo] are fixed. Our approach is based on the following simple observation: Let 
A G R niXn2X '" xn <i be an arbitrary non-zero order-c? tensor. Then, 

VM\_(A,d) = max vml(A(x ), d — 1). 

II^IIp^ 1 

This suggests that it may be possible to approximate the degree-d problem vmi(A, d) if we have 
an algorithm for approximating the degree-(d — 1) problem vml(<6, d — 1), where B is an arbitrary 
non-zero order-(d — 1) tensor. To implement this idea, we proceed as follows. Let % be an 
arbitrary Hilbert space. Given an arbitrary non-zero order-d tensor A = (oi 1 i 2 — i d ) S W llX "' xnd , 
let F A be the associated multilinear form, and define a function F A : R ni x • • • x R nd - 2 x 7i rid - 1 x 
U nd -> M by 

Fa(x\..., x d ~\ , K}^) = £ - £ £ £ a n ... id _ 2jfc • ^ • • • <-_ 2 2 • ujtfc. 

ii=l »d-a=l i =1 fc=1 

By Proposition [3l for any given x l G M ni , where i = 1, . . . , d — 2, we have 

-^■vec p (A(x\...,x d ~ 2 )) < A(x\...,x d - 2 ) <vec p (A(x\...,x d - 2 ) 

Since 

A{x x ,...,x d ~ 2 ) =max\F A (x 1 ,...,x d - 2 ,x d - 1 ,x d ) : ||x d_1 || p < 1, \\x d \\ p < 1 



it follows that 



-rr~ ■ rMt(A,d) < max F^x 1 , . . . ,x d ) = v ML (A,d) < r ML (A,d), 

Kq ||a; 1 ||p<l,i=l,...,(i 

where 

r ML (A,d) = maximize F A (x 1 , . . . , x d ~ 2 , {uj}^ 1 , {v k }^±i) 

subject to \\x l \\p < 1 for i = 1, . . . , d — 2, 

||u|| p < 1, ||v|| p < 1, (22) 
u=(||ui|| 2 ,...,||u nd _ 1 || 2 ) GM nd -!, 

V= (|Ml2,---,IKj2) G 



In particular, VM[_(A,d) and rMi_(y^cO are equivalent from the approximation perspective. In 
the sequel, we shall focus on designing approximation algorithms for the latter using both deter- 
ministic and randomized approaches. 
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5.2.1 Deterministic Approximation of rM\_(A,d) 

Our deterministic approach is motivated by the results developed in [26 . Before delving into 
the details, let us give an overview of the approach. Suppose there is a deterministic algorithm 
that can approximate the problem rMi_(i3, d — 1) for any non-zero order-(d — 1) tensor B, where 
d > 4 is fixed. Then, given an arbitrary x 1 G W 11 , since A(x 1 ) is an order-(d — 1) tensor, we can 
apply the algorithm to the problem 



r^Aix 1 )^- 1) = maximize F A (x 1 , . . . , x d 2 , {uj}^i , { v k}1ti 

subject to \\x l ||p < 1 for i = 2, . . . , d — 2, 



||u|| p < 1, ||v|| p < 1, 

u= (||u 1 || 2) ...,|K d _ 1 || 2 ) eR n *-i, 

v = (||«i|| 2 , . . . Jv„J 2 ) G R"< 

and obtain a value G^-i^ 1 ) that satisfies ^d-r^ML^^ 1 )) d— 1) < G f j_i(x 1 ) < fML^^ 1 ), d— 1), 
where fid—i 6 (0? 1) is the approximation ratio of the algorithm. Since this holds for any x 1 G R ni , 
it follows that 

Ai-l • ^ml(-4, d) < max Gd-iix 1 ) <r M \_(A,d). 

Now, if we can show that the function Gd-i defines a norm on R™ 1 , then maxiuiii <i Gd—i(x) 
is a norm maximization problem, which can be approximated using the techniques outlined in 
Section [5.11 This would then yield an approximation algorithm for the problem tm\,(A, d). 
To carry out this plan, we need the following result: 

Proposition 8 Let d > 3 and p £ (2,oo] be given. For i = 1, . . . , d — 3, let Pi be a centrally 
symmetric polytope in R ni+1 satisfying the properties stated in Theorem [7j Furthermore, let 
A = (oiii 2 — i d ) £ jcix^x-xiii £ e an arbitrary non-zero order-d tensor. Define the functions 
kf 4 : M ni x R na x • • • x -> R + for i = 1, . . . , d - 2 inductively as follows: 



(23) 



Af'V,^,...,^) = tofl : A^(x\x 2 ,...,x\y) < l}° 

/or i = d — 3, d — 4, . . . , 1. Then, the following hold: 

(a) For j = 1, 2, . . . , d — 2 and /or any x 1 , . . . , x fc_1 , . . . ,x\ where x % G R n % i/ie function 
Kff : M. n " -»■ R+ 5 raen oy 

Tv4, (i/ \ A .4,d/-1 -fc— 1 -fc+1 -7\ 

A j,fc ( x ) = A j ( x ' • • • > 35 ' x > x ' • • • > x ) 

zs a semi-norm on R nfc /or any G {1, . . . , j}. 
(7>j Lei ^4 6e i/ie (n 2 x • • • x rid) x ni matrix given by 

A (i 2 ,...,id),h = a hi2-id forij = l,...,rif, j = l,...,d. (24) 
Suppose that A has full column rank. Then, the function A^' d defines a norm on R ni . 
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(c) We have 

A^f U -\x 2 ,x 3 , ...,x i ) = A?> d (x\x 2 , . . . , x l ) for i = 2,3,..., d- 2. 

Proof Both (a) and (b) are essentially adaptations of the corresponding claims in [261 Propo- 
sition 4]. To prove (c), we proceed by backward induction on i. For i = d — 2, we have, by 
definition, 

A^" 1 ^ 2 ^ 3 ,...,^- 2 ) = yec p ([A(x')](x 2 ,x 3 ,...,x d - 2 ] 

(A{x\ 



vec„ I .Alar, x 2 , ... ,x d 2 ] 



— A^_ 2 (2; , x ,...,x ). 
For the inductive step, we use both the definition in f|23|) and the inductive hypothesis to obtain 

Aff )4 ~\x 2 ,x 3 , . . . y) = diam Pi [[y G M"' i+1 : Af ^ d ~\x' 2 , x 3 , ...,x\y)< l}°" 

= diam Pi [{yerw :Af£{x l ,x 2 ,...,x i ,y) < l}° 

kA,d, 12 i\ 
= A • ' [X ,X ,X). 

This completes the proof. □ 

We are now ready to prove the main result of this section: 

Theorem 7 Let d > 3 and p G (2,oo] be given. Let A = (a h i 2 ... id ) G R«ixn 2 x-xn. d be an 
arbitrary non-zero order-d tensor. Consider the functions {A~^ ,d } d ~ 2 defined in &23\) and the 
(ri2 x • • • x rid) x n i matrix A defined in (2~4\ ). Suppose that A has full column rank. Then, the 
following hold: 

(a) For any given x G M. ni , the norm A^ ,d (x) is efficiently computable; i.e., it can be computed 
to any desired accuracy by a deterministic algorithm whose runtime is polynomial in the 
input size of Problem \22\) and the level of accuracy. 

(b) There exist rational numbers < r < R < oo, whose encoding lengths are polynomially 
bounded by the input size of Problem A 2 2]), such that 



B^{r) C [x G IT 1 : A^ d (x) < l} C B^{R). 



Consequently, the quantity diamp (fx G R ni : A^' d (x) < can be efficiently computed, 

where Pq is a centrally symmetric polytope in M ni satisfying the properties stated in Theo- 
rem^ 

(c) We have 

Q /j-j (logn^/A ^^^^ < }_ diampo G R m . A Ad {x) < 1 j°) < rML ( Ad ). 



vi=l 
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In particular, there is a deterministic polynomial-time algorithm for Problem (ML) with approx- 
imation ratio Q ( E[f=i (l°g ni) 1 ^ / n 1 / 2 J . 



Proof We proceed by induction on d > 3. The base case follows from (|16p . Proposition [5] 
and Theorem |U Now, suppose that d > 3. Let xi € R ni \{0} be arbitrary, and consider the 
order-(<i — 1) tensor A(x 1 ) G ]R ra 2xra3x---xn d _ Without loss of generality, we may assume that the 
(^3 x • • • x nd) x ri2 matrix A(x 1 ), where [A(x )]u 3 , ...,i d ),i 2 = [■A(x 1 )]i 2 i 3 ...i d , has full column rank. 

y^fx 1 ) d—1 

By the inductive hypothesis, A 1 is an efficiently computable norm on M n2 and the set 



{x G M™ 2 : Af (xl) ' d -\x) < l} is well-bounded. Moreover, using (|23p and Proposition [HJ 



c , we 



have 



A^x 1 ) = diam Pl [{x G R na : A^<V,x) < = diam Pl [{x € M™ 2 : Af {xl) ' d ~\x) < l} 

Hence, by arguing as in the proof of Proposition [5] and applying Theorem we conclude that 
A^ ,d is an efficiently computable norm on R ni . 

Let B A A,d = jx G W 11 : A^' d (x) < l| be the unit ball of A^' d . Using the argument in the 
proof of |26} Theorem 4], one can show that B^A,d is well-bounded. As a corollary, we see that 
B° Ad is also well-bounded, and that the weak membership problem associated with B° Ad can be 

solved in deterministic polynomial time. This implies that diamp (jx G R ni : Af' d (x) < l}° 
can be efficiently computed. 

Now, the inductive hypothesis, the definition of A^' d in (|23p and Proposition [HJ^c) yield 



n 



Q^^VrML^ 1 )^-!) < idiamp 1 ({xGR-:Af^- 1 (x)<l}° 



< r ML(A(x^) , d — 1). 

Since tml^, ^) = m ax|| x i|| p<1 ^ivilC-^C^ 1 ): it follows that 
"' 2 (log",!' 



II 1/2 - )^ML(Ad)<^ max Af'V)<r ML (Ad). (25) 



By mimicking the derivation of (|16p . one can show that 

max A^x 1 ) = -diarn, (B° A . d ) . (26) 
ll^ 1 ll?>< i 2 \ A i / 

Moreover, since B° Ad is well-bounded, Theorem 0] and the definition of Pq imply that 
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It then follows from (1251), (|261) and (EH) that 



n / (logn^/A d) ^ idianifb ({* G M ni : Af' d (x) < l}°) < r ML (A, d). 

\i=i n i J 

This completes the proof of Theorem [7J □ 
The following is an immediate corollary of Theorems [2] and [7J 

Corollary 2 For any given d >3 and p G (2, oo], there is a deterministic polynomial-time algo- 
rithm for (HP) with approximation ratio (resp. relative approximation ratio) ((log n)^ 2 ^ p j n d ^ 2 ^ 1 ^ 
when d>2> is odd (resp. even). 

5.2.2 Randomized Approximation of ru\_{A,d) 

As in the case where d = 3, we can approximate rw\_(A,d) using a randomized approach. Such 
an approach is based on the following result, which states that every optimal solution to Problem 
(|22p satisfies certain probabilistic inequality: 



Proposition 9 Let 

(x\...,x d -^{u j }]t 1 \{v k } n k ii) 
be an optimal solution to Problem 



(a) Let C G W 11 be a vector of i.i.d. Bernoulli random variables. Then, 



Pr ( FA (C, x\ ■ ■ ■ , x d ~\ {^I 1 , i^lU) > a/^P • rMLGA, d) > . 



where the constants 5q,cq are given by \20\ 



(b) Let £ G R" -1 be a vector of i.i.d. random variables with density p-exp(—\t\ p )/(2T(l/p)), and 
set£ = Z/U\\p- Then, 



Pr\F A U,x 2 ,...,x d -^{u ] }^ 1 \{v k }^ > ' 



Co 

/or a// n>n, where the constants 5i,ci,C2,n are given by §21\). 
Proof Let w G M. ni be the vector defined by 

?12 n d-2 n d-l rid 

w h = J2'-- Yl Y^ a hi2---i d -2jk-xi---x d - 2 2 -ujv k for »i = 1,...,t»i. 

«2 = 1 id-2 = l i = l fc=l 



Then, for any x G R ni , we have 



T 
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Moreover, by the definition of rM\_(A,d) and Holder's inequality, we have 



r Ml (A,d) = F A (x\x',...,x a -',{u j }]t 1 \{v k } n k l 1 

= max i F A (x\x 2 ,..., x d ~\ {uj^ti , {v k } n k i x 



w 



Thus, the desired result follows from Proposition [6j 



□ 



Theorem 8 For any given d > 3 and p G (2, oo], there is a randomized polynomial-time al- 
gorithm for Problem $22\) that returns vectors x , . . . , x d ~ 2 , {iij}™^ 1 , {v k } k l 'Li with the following 
property: 

.d/2-l TT A°g n * ~- - * - , . J - 1 



Pr 



-n 

i=l 



• r ML (A, d) < G(A, d) < r ML (A, d) 



> 



Here, G(A, d) = F A (x\ . . . , x d ~ 2 , {u^ti , {vk} n k d =1 ) and 

( 5 ifp G (2,oo), 

K = < 

[ #i ifp = oo, 

where the constants So, 5% are given by [2U\) and ([HP, respectively. 



Proof We shall prove the theorem only for the case where p G (2, oo); the case where p = oo will 
be similar. The proof proceeds by induction on d > 3. The base case follows from Proposition [7J 
Now, set M = (2 In 2)n^ 2 /ci, where the constants ci,C2 are given by (|21[) . Consider a collection 
: i = 1, . . . , M; j = 1, . . . , n\} of i.i.d. random variables with density p ■ exp(— \t\ p ) / {2T{l/p)). 
Define 



nei 



for £ = 1,...,M. 



By the inductive hypothesis, there is a randomized polynomial-time algorithm that can compute, 
for each i = 1, . . . , M, a number G(A(C), d — 1) satisfying 



Pr 



d-2 : , 
(d-3)/2TT l l °S n i 



n 

i=2 



r ML (A(e),d-l)<G(A(C),d-l)<r ML (A(e),d-l) 



1 

> -. 

~ 2 



Now, consider the events 



n 

i=2 



d-2 : , 

(d-3)/2 TT /logrtj 



r ML (^(e),d-l)^ fori = l,...,M 



and let 



x\...,x d - 2 ,{u J }%- 1 \{v k }l± 1 ) 
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be an optimal solution to Problem (|22p . Note that Pr(E'j) > 1/2 for i = 1,. . . , M. We compute 

d-2 



Pr [G(A(e),d- 1) > df" 1 J] J^.r ML (i,d) 



d-2 



> Pr G(A(e),d - 1) > ^f 2 - 1 J] J — • rw L (A d) 



, , n,: 



£i x Pr(^) 



> \prL M aA(e),d-i)>^ 5 -^^-r M aA,d)) (28) 



* tn ^2 ^-2 r.-, r= in. \ ^ Milogni 



where (|28|) follows from the fact that is independent of the randomizations used to compute 
G(A(C),d — 1), and ([29]) follows from Proposition Mjo). Upon setting 

G(A,d) = max G(A(?),d- 1), 

\<i<M 

we conclude that 

cZ-2 



pr w>^nv— 



i=i 



M / d-2 



> i - n ^ G^cf), d - 1) < <5f 2 - 1 n v — • d) 



i=l \ i=l 
, M 



1 

> -. 

~ 2 

This completes the proof. □ 

Corollary 3 For any given d>3 and p G (2,oo], i/iere is a randomized polynomial-time algo- 
rithm for Problem (HP) wii/i approximation ratio (resp. relative approximation ratio) Q ((logra/n)^ 2-1 ) 
w/ien d is odd (resp. even). 

6 Conclusion 

In this paper, we studied the hardness and approximability of homogeneous polynomial op- 
timization and related multilinear optimization problems with L p -ball constraints. A crucial 
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first step in our proofs is to relate the polynomial optimization problem at hand to a suitable 
multilinear optimization problem. To obtain approximation results, we further showed that the 
Lp-ball constrained multilinear optimization problem is equivalent, from an approximation per- 
spective, to that of determining the diameters of certain convex bodies. Such equivalence was 
established using the Grothendieck inequality (see, e.g., [144 123j) and an argument of Khot and 
Naor [13J (cf. [26J). Consequently, by extending the approaches in [131 [26] an d applying results 
from algorithmic convex geometry, we were able to develop both deterministic and randomized 
polynomial-time approximation algorithms for various L p -ball constrained polynomial optimiza- 
tion problems, whose approximation guarantees are currently the best known in the literature. 
We believe that the wide array of tools used in this paper will have further applications in the 
study of polynomial optimization problems. In addition, it would be interesting to find more 
applications of the optimization models studied in this paper. 



Appendix 

A Proof of Theorem [2] 

The proof of Theorem [2] relies on the following polarization formula, whose proof can be found, 
e.g., in [TTJ Lemma 3.5]: 

Proposition 10 Let x 1 ,x 2 ,...,x d G R n be arbitrary, and let £i,£2> • • • >£d be i.i.d. Bernoulli 
random variables (i.e., Pr(£j = 1) = Pr(£, = —1) = 1/2 for i = 1, . . . , d). Then, we have 



E 



\i=l 



J=l 



d\-F A (x\x 2 ,...,x d ). 



(30) 



Armed with Proposition 1101 we proceed as follows. Let (x l ,x 2 , . . . ,x d ) be the feasible solution 
to Problem (MR) returned by ^mr- By assumption, we have \\x l \\ p < 1 for i = l,...,d and 
Fa (x 1 ,x 2 , . . . , x d ) > av* . When d > 3 is odd, we can rewrite (|30l) as 



d\-F A (x 1 ,x 2 ,...,x a ) =E 



116 )fA £«, 



\i=l 



J=l 



E 



x J 



In particular, since d > 3 is assumed to be fixed, we can find in constant time a vector /3 
(Pi, fa, ...,Pd)€ {-1, l} d that satisfies 



I E lift 1 xj 1 ^ dl • f a(*\x 2 > ■ ■ -^ d )- 



Now, set x = Ej=i [flw Pi) x 3 l EU [Ui^ ft ) * 
feasible for Problem (HP). Moreover, since 



Then, we have \\x\\ p = 1; i.e., it is 



£ lift" 

i =1 v¥=j 



— II^'IIp — ^' 

3=1 
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we conclude that 



, . d\F A (x 1 ,x 2 ,...,x d ) . . 

f A (x) > ^-M — — '— >a-d\-d- d -v*>a-d\-d- d -v, 



as required. 

Next, consider the case when d > 4 is even. Observe that every realization of the random 
vector £ = (£1,^2, ■ ■ ■ G {— 1, l} d satisfies 



1 d 



<IJ2\W\\ P <1; 
j'=i 



i.e., g X^=i C? 3 ^ * s feasible for Problem (HP). Now, using the identity (|50j) . we compute 



E 



n«. u. E« 



iX;' 



\i=\ 



J =1 



-E 



d d . 



-E 



< —E 
2 



P' X, J 


1- 


n«. 

i=l 






d 






n«< 

i=l 






d 






i=l 



where the last inequality follows from the fact that f A \ \ Y2j=i ^j x ^J ~V- ls always non-negative. 
In particular, we can find in constant time a vector (3 = {fix^ii ■ ■ • > Pd] £ { — 1> l} d that satisfies 
nf=i ft = 1 and 



2d! 



^> ^•F 4 (x 1 ,x 2 ,...,x d ). 



Upon setting x = | ^2j=i @j x ^ an d observing that v* > v > v > —v*, we obtain 

f A (x) - v > 2a ■ d\ ■ d' d ■ v* > a ■ d\ ■ d~ d ■ (v - v). 
Moreover, we have \\x\\ p < 1. This completes the proof of Theorem [2j 



□ 
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B Proof of Theorem [3] 

Let d > 3 and p G [2, oo] be fixed. We shall reduce Problem (ML) to Problem (MR), again 
by using the symmetrization procedure introduced in Section [2j Towards that end, let us first 
establish some preparatory results. 

Proposition 11 Let A G flj n i xn 2 x "-x™d ^ e an ar })ii rar y order~d tensor and sym(A) G WL Nd be its 
symmetrization, where N = m + ri2 + ••• + nd- Moreover, let z % = [ (z t,1 ) T (z t,2 ) T ••• (z' l,d ) T ~\ G 
M. be given, where z 1 ^ G W 1 ^ for i, j = 1, . . . , d. Then, 

F sym{A) {z\z\ ...,z d )= Y, F A (z^\z^ 2 , z^> d ), 

(7ri,7r 2 ,...,7r d )eS (J 

where Sd is the set of permutations of {1, 2, . . . , d}. 

Proof Using the sets B\, ... , defined in ([3]) and the definition of sym(.4), we have 



Z i d 



7r=(7ri,...,7r d )eS' [ i S SS7r j 
j=l,...,d 



7T=(7ri,...,7r d )eS' [ j 11=1 «d=l 



z 1 > 7r l . . . z rf > 7r d 



711 " d _1 1 _1 d 

= £ £ " ' E t^U-id Z h ' ' ' Z id ' 

7r=(7Ti,...,7r [ j)eS [ j U = l «d = l 

where 7r _1 = (vr^ 1 , . . . , tt^ 1 ) G Sd is the inverse of tt; i.e., 7T -i = j for j = 1, . . . , d. Consequently, 

i 

we obtain 



F sym{A) (z\...,z d ) = F A (z^ 1 >\...,z^ 1 > d )= F A (z^\...,z" 



1 >■■■)' 

(7ri,...,7r ti )eS d (ni,...,TT d )£S d 

as desired. □ 



Proposition 12 Let p G [2,oo) 6e /feed Given an integer n G [2,d], define the function f n : 
[0, d] n ->R by 

n 

f n (x l ,...,x n ) = J2x] /P H(d-x :i ) 1 ^. 

i=l jjti 

Then, for any (x%, . . . , x n ) G [0, d] n , we have 

fn(xi, ... ,x n ) < f n (-, ...,-) = d n l? ■ n 1 - 1 '* -(l--) {n 1)/P ■ (31) 
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Proof We prove (|3ip by induction on n. For the base case (i.e., n = 2), consider the problem: 

(P2) max{/2(xi, X2) : < Xj < d for i = 1,2}. 

Note that an optimal solution to (P2) must either lie on the boundary of [0,(i] 2 , or lie in the 
interior of [0, d] 2 and be a solution to the following first-order necessary conditions: 

x Wrt- 1 (d-x 2 ) 1 /P = xl /p {d- Xl )W*>-\ (32) 

x^M-^d-xt) 1 ^ = x] /p {d-x 2 fM-\ (33) 

Consider an arbitrary x = (xi, x 2 ) G [0, d] 2 . If x is a boundary point of [0, d] 2 , then the structure 
of / 2 implies that 

/ 2 (xi,x 2 ) < max{/ 2 (0,d),/ 2 (d,0)} = d 2 ^. 
On the other hand, suppose that x G (0,d) 2 satisfies (J35]| and (J33J). Then, 

1 ' 1 ^ and = "At , (34) 



d—xij \d — x 2 J \d — x 2 J \d — x\ 

which together yield xix 2 = (d — x\){d — x 2 ), or equivalently, x\ + x 2 = d. If p = 2, then 
any (xi,x 2 ) G [0,d] 2 satisfying xi + x 2 = d will be an optimal solution to (P 2 ). In particular, 
we have f 2 {x\,x 2 ) < f 2 (d/2,d/2) = d for all (£1,2:2) G [0,d] 2 in this case. If p > 2, then 
upon substituting x\ + x 2 = d into (fM|) . we obtain a unique solution xi = x 2 = d/2. Since 
/ 2 (xi,x 2 ) = 2(d/2) 2 /P > d 2 / p for any p > 2, we conclude that (d/2,d/2) is the optimal solution 
to (P 2 ). This establishes the base case. 

For the inductive step, consider the problem 

(P n ) max{/ n (xi, . .. ,x n ) : < Xi < d for i = 1, ... ,n}, 

where 2 < n < d. Again, an optimal solution to (P n ) must either lie on the boundary of [0, d] n , 
or lie in the interior of [0, d] n and be a solution to the following first-order necessary conditions: 

(Vp)-1 / „. \ i/p 

0/ 7 



E A for*=l,...,n. (35) 



d _/ V d x 

Consider an arbitrary x = (xi,...,x n ) G [0,d] ra . Suppose first that x G (0, (i)™ satisfies ([35]) . 
Let = Xi/(d — Xi) for i = 1, . . . ,n. Then, we obtain from (|35p that (ttj)^ 1//p ^ _1 — (uj) p = 
u- p — uj % ', or equivalently, 

(u i )Wri- 1 (l + u i ) = (u j )( 1 M- 1 (l + u j ) fovl<i<j<n. (36) 

It is easy to verify that the function t 1— > t( 1 / p ^~ 1 (l + t) is strictly decreasing on (0,p — 1] and 
strictly increasing on [p — 1, 00). Thus, if we let I\ = {i : U{ < p — 1} and I 2 = {i : ui > p — 1}, 
then (|36|) implies that = Uj = u for all i,j G ii and Uj = Uj = v for all i,j G I 2 ; i.e., Xj = Xj 
whenever i,j G I\ or i,j G / 2 - We claim that in fact I 2 = 0. To prove this, let us first show that 
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1-^2 1 5; 1- Suppose to the contrary that I/2I > 2. Let i,j 6 -Z2 be such that i ^ j. Then, from ([35 
and the fact that Ui > for i = 1, . . . , n, we have 



it 



(Vp)-i i/p 



E 



ul /p > 0. 



However, since > p — 1 > 1, we have «j 1 — u l J p < 0, which is a contradiction. It 

follows that II2I < 1- 

Now, suppose that I-Z2I = 1- Then, from ([35]) , we have 



V {l/P)-1 = ( n _ ^l/p 
This, together with ([36]) . implies that 

„(i/p)-i(l + u ) = ( n _ i) u Vp h + ( n - i)p/(i-p) u i/(i-p) 

or equivalently, 

(n - 2)u + (n - 1)V(i-p) u (p-2)/(p-i) = 1. 



(37) 



(38) 



Since both summands in (I38p are non-negative, we clearly have u < l/(n — 2) < 1. We claim 
that 

1 - (n - I)V(i-p) 
„>„ s _L_i . (39) 

Indeed, suppose to the contrary that u < f3. Then, using the fact that u < 1, we have 

(„ _ 2 )« + (n - i)V(i-P) n (P-2)/( P -i) < ! _ (n _ !)!/(!-*>) + (n _ 1) i/(i- P ) n ( P -2)/(p-i) 



= 1 + (n- l)V(i-p) 
< 1, 
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(p-2)/(p-l) 



which contradicts (|38p . This establishes (|39p . 

We now show that (f39[) leads to v < 1, which would contradict the definition of u. Indeed, 
using (|39l) . we have 

J )P [l-(n-l)V(i-p)l. (40) 



(n - l) p u > 



n - 2 



Consider the function h : [2, 00) — > R given by 

%) = (n-l) p [l- (n-l) 1 /^) 
By a routine computation, we have 



h'(p) =ln(n- 1) • (n-lf 



1 - (n- 1 



,i/(i-p) 



.(„_1)1/(1-P) 
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Observe that 



1 _ („ _ i)V(i-p) _ _i_ ( n _ i)V(i-p) > o 

1 



n — 1 



i/(p-i) 



1 + 



(P " I) 2 



< 1 



1 + 



(p-lf 



< 2 V(p-i). 



(41) 



It is straightforward to show that (|4ip holds for p E [2, 3] by comparing the slopes of the functions 
p \— )■ 1 + (jp — 1)~ 2 and p i — y 2 l l <yP ~ l \ For p > 3, we have 



1 



< e < 2 2 < 2 P "\ 



which implies that (j41|) holds. Thus, we see that /i is increasing on p E [2,oo), and from (j40j) we 
obtain 



(n - l) p u > 



(n - l) p 



1 - (n - 1) 



~ n-2 



1 



n — 1 



n - 1 > 1. 



n-2 

This, together with (J3T|) . implies that 

v = ((n-iyu) 1/(1 - p) <1, 

which is the desired contradiction. 

Thus, we have shown that I/2I = 0. Using (|35p . we then have u^/p)" 1 = (n — l)n 1//p , or 
equivalently, n = l/(n — 1). It follows that x = (d/n, . . . ,d/n) is the unique solution to (I35|) . 

Next, we show that if x lies on the boundary of [0, d] n , then f n (xi, . . . , x n ) < f n (d/n, . . . , d/n). 
Towards that end, we first note that 



fn [ i 

n 



d 



n 



1 \ 

<T /p • n 1 - 1 ^ • 1 - - 



1 



n 



n — 1 
1 

n — 1 



n 
i/p 



n/p 



1/P / 1 \ VP 

• e -Vp.(l_I) 

n / 



> d n/p -^e 



(42) 



where the last inequality follows from the fact that p > 2. Now, suppose that X{ = d for some 
z = 1, ... ,n. Since the function f n is symmetric in its arguments, we may assume without loss 
that i = n. Then, using ([42 p and the fact that n > 3, we have 

d 
n 



f n (x 1 ,...,X n - ll d) < d n/p < f n (-, 
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On the other hand, suppose that x n = 0. Then, by the inductive hypothesis, 
f n (xi, . . . ,ic n _i, 0) = d 1/p • /„_i(xi, . . . ,X n -i) 

1 \(f'-2)//. 



< d 1/p ■ S n - 1)/p ■ {n - l) 1 - 1 ^ ■ (1 
1 \ Vp 



d n/p (n - 1) 



n-2 



1 



71 — 1 

j \ (»-1)/p 



n — 1 



Since re > 3 and p > 2, we have 

1 \ Vp 

(re -11' 



n-2 



n — 1 



(n-l)/p 



1 \ 1/p / 1 \ ™/p 

< „ I — - 1 - 

re — 1 / V re 



n 



n — 1 



n 



1 



1 



re — 1 \ re — 1 

1-2/p 



2/p 



1 + 



1 + 



1 



re (re — 2) 
1 

refre — 2) 



n/p 



> 1 



2/p 



> 1 



n 



> 1. 



^re — 1 

Hence, we obtain from (I43D that 



x„_i,0) <cT/ p -re - (^i) 
This completes the proof of Proposition [T2l 



i/p 



^ \ ™/p 

1 

re 



/n - 



d d 



, . . . , 

re re 



Proposition 13 Let A G M niXn2X '" xra d fre an arbitrary order-d tensor and sym(A) £ 
iis symmetrization, where N = n\ + n>2 + • • • + n d . Consider the optimization problems 

r(A d ) = maximize dl ■ F_a(x 1 ,x 2 , . . . ,x d ) 

subject to \\x l \\ p < 1, x' G M™ 1 /or i = 1, . . . , d 



and 



(43) 



□ 
be 



{A, 



(B d ) 



r(B d ) = maximize F^^z 1 , z 2 , . . . , z d ) 

subject to \\z% < dV p , z l eR N for i = 1, . . . , d, 

where Fj[ (resp. F sym (A)) is the multilinear form associated with A (resp. sym(A)). Then, the 
following hold: 

(a) T(A d ) = T{B d ). 

(b) Let (x 1 ,x 2 ,...,x d ) el" 1 xl" 2 x • • • x M. nd be an optimal solution to Problem (Ad). Set 

i T 

(44) 



(x 1 )? (x 2 ) T 



r„d\T 



eR N fori = l,...,d. 
Then, (z l ,z 2 , . . . , z d ) constitutes an optimal solution to Problem (B d ). 
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(c) Let ( z 1 , z 2 , . . . , z ) G R^ x R^ x • • • x Wl N be an optimal solution to Problem (B d ) with 

r 



z l 



fi,if . . . ( S i,df G rJV> G R n, /or ij = 1 ^_ fd , (45) 



Then, \\z t,J \\p = 1 /or i,j = l,...,d. Moreover, there exists a vector z G R u>i£/z 

(x 1 ) 7 ^ 2 ) 7 ••• (x d ) T j T , i'eR"' fori = l,...,d, 

such that (z, . . . ,z) is an optimal solution to Problem (B d ) and (x 1 , x 2 , . . . , x d ) is an optimal 
solution to Problem (A d ). 

Proof By Proposition II 11 Problem (B d ) is equivalent to 

r(B d ) = maximize ^ F A (z* ul , . . . , z Wd ' d ) 

neS d (B' d ) 

subject to \\z% < d}/ p , z i ER N for % = 1, . . . , d. 

If (x 1 , . . . ,x d ) G R rai x ••• x R n<1 is an optimal solution to Problem (Ad), then the solution 
(z l , . . . , z d ) G R N x • • • x R^ as defined in ()44p is feasible for Problem (B d ). Moreover, we have 

r(B d ) > F A (z ni '\ • • • , z^ d ) = d\ ■ F A (x\ ...,x d ) = r{A d ). 

Hence, (b) is implied by (a). 

To prove (a) and (c), we consider two cases: 

Case 1: p = oo. Consider an optimal solution (z 1 , . . . , z d ) G R^ x • • • x R^ to Problem (B d ) 
with z l given by ([431) , Then, (z 1 ,. . . ,z d ) is also optimal for Problem (B' d ). Let r G S d be a 
permutation of {1, . . . , d} satisfying 

F 4 (5 T1 ' 1 ,...,z Td ' d ) > Fa^ 1 ' 1 ,...,^^) forall7TG5 d . (46) 

By the optimality of (z 1 , . . . , z d ) for Problem (-B^) and the fact that || 

we have Hz^Hoo = 1 for i,j = l,...,d. Now, set x % = z n ' 1 for i = l,...,d and form z = 
[ {x 1 ) 7 ■ ■ ■ [x d ) T ] G R^. By construction, we have || 

•^||cx) — 1 cincl hence (z, . . . , is feasible 

for Problem {B' d ). Using (jl6|) , we compute 

Y,F A {x\...,x d )= Y,F A (z^\...,z T d> d )> Y,F A (~z^\...,z^ d ) = r(B d ), (47) 

ires d ires d Kes d 

which certifies the optimality of (z, . . . , z) for Problem (B' d ) and hence also for Problem (B d ). 

Moreover, since ||x l ||oo < Halloo = 1 f° r i = (ic 1 , . . . , x d ) is feasible for Problem (A d ). 
This implies that 

Y, F A(x\ ...,x d ) = d\- F A (x\ ...,x d )< r{A d ). (48) 

1T&S d 

Upon combining (j4"T|) and (}4"8]) . we have t(A^) > r(B d ), and that (x 1 , . . . , x ) is an optimal 
solution to Problem (^4^). This establishes (a) and (c) for this case. 
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Case 2: p £ [2, oo). We prove (a) and (c) by induction on d > 2. For the base case (i.e., d = 2), 
we have A 6 M. niXri2 . Hence, we can write 

t(A 2 ) = 2max{x T Ay : \\x\\ p < 1, \\y\\ p < l} (A 2 ) 

and 

t(B 2 ) = max{(v 1 ) T Au? + (™T^ 2 : + ||v 2 ||£ < 2, + ||^ 2 ||^ < 2} . (B 2 ) 

Let (z\z 2 ) G M n i+ n 2 x M"i+ n 2, where z 1 = [(v 1 ) 7 ^ 2 ) 7 ] and z 2 = [(w 1 )? {w 2 ) T ], be an 
optimal solution to Problem (B 2 ). Suppose that \\v \\p = k\ and H^Hp = k 2 . Then, 

t{B 2 ) < m&x^fAw 2 : Wv 1 ^ < k h \\w 2 \\p < 2- k 2 ) 
+ max{(ii; 1 ) T .Ai> 2 : H^ 1 ^ < k 2 , \\v 2 \\ p p < 2- h} 

= ^ [k{ /P (2 ~ k 2 )^ + k\ ,p {2 - h) 1 '* 
< t(A 2 ), 

where the last inequality follows from Proposition [12] and the fact that < k\,k 2 < 2. This 
establishes (a). Moreover, since all the above inequalities hold as equalities, from the proof of 
Proposition 1121 both k\, k 2 must equal to 1 when p > 2 and can be taken as 1 when p = 2. This, 
together with the optimality of (z l ,z 2 ), implies that we can take v 1 = w 1 and v 2 = w 2 . Upon 
setting x l = v i for i = 1,2 and forming z = [ (x l ) T (x 2 ) T ] , it can be verified that (c) holds. 
Thus, the base case is established. 

Next, consider an optimal solution (z l , . . . , z d ) to Problem (Bd) with z l given by (j4"5j) . Sup- 
pose that ||5*' rf ||p = ki for i = 1, . . . , d. Then, 

r(B d ) = £ F A (z^\...,z^ d ) 

TT&S d 

= E E F A( ^ ) (z^\...,z^' d - 1 ) 

i=l n^S d :TT d =i 



< E , 1P . J ™^_ E ^(^K 1 - 1 ,..,^- 1 ^- 1 ) 

TeS d :ir d =i 



~f \\wJ\\P<d-k i ,wieR N ~ n d 
j=l,. ..,<-!,»+!,. ..,d 



' J/ " j=i,..,d-l 7re5d " 1 

1/p 



*— 1 JT 4 * i=l,...,d-l 



i=i v a / 



,i^||p<i,^'eK n -'' \\x d \\l<ki,x d &M. n d 
3+ l i=i,...,d-l 
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r(A d ) ^ i/p 



E & rri( d -%: 



v 7 2=1 J^J 



1/P 



< r(Ad), (50) 

where (|49p follows from Proposition [11] and the inductive hypothesis, and (|50p follows from 
Proposition [12] and the fact that < ki < d for i = 1, ... ,d. This establishes (a). Moreover, 
since all the above inequalities hold as equalities, the proof of Proposition [12] shows that we 
must have k{ = 1 for i = 1, . . . , d. This implies that ||-S i,rf ||p = 1 for % = 1, . . . , d. By repeating 
the above argument using the group : i = 1, . . . , d} in place of {z l,d : i = 1, . . . , d} for 
each j = 1, . . . , d — 1, we conclude that || p = 1 for i, j = 1, . . . , d. Now, as in Case 1, let 
t £ Sd be a permutation of {1, . . . , d} satisfying ([4"6]) , Set x 1 = z Tul for i = 1, . . . , d and form 

z = [ (x 1 ) T ■ ■ ■ (x d ) T ~\ S M. N . By construction, we have 



z 



IP — IIAMIP — ll? Ti ' i l|P 

\p ll x lip IK lip 



and hence ... ,z) is feasible for Problem (Bd). It remains to argue as in Case 1 to complete 
the inductive step and also the proof of Proposition [131 d 

Proposition 1131 implies that for any given d > 3 and p € [2, oo], any instance of Problem (ML) 
can be converted into an instance of Problem (MR) in polynomial time. Since Problem (ML) is 
NP-hard by Proposition [T] it follows that Problem (MR) is also NP-hard. This completes the 
proof of Theorem [3] □ 
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